All Questions
6 questions
6votes
1answer
5kviews
Async download of files
The following code is an async beginner exploration into asynchronous file downloads, to try and improve the download time of files from a specific website. Tasks: The tasks are as follows: Visit ...
- 375
4votes
1answer
2kviews
Scraping urls asynchronous including exception handling
I'm trying to understand how to work with aiohttp and asyncio. The code below retrieves all websites in ...
- 362
3votes
1answer
4kviews
Scraping with asyncio/aiohttp and retrying the request on error
I am doing some practicing with back-connect proxies and asyncio/aiohttp. The IP changes on every request to the proxy and I am allowed up to 1500 threads. The big issue with back-connect proxies, is ...
- 131
1vote
0answers
444views
Scraping web data using asynchronous request
I've written a script using python to grab different categories from a webpage. I used "grequests" in my scraper to perform the activity. My intention here was to perform the action swiftly making ...
- 2,511
3votes
1answer
65views
Depleting certain data from a webpage asynchronously
I've written a scraper in python using asyncio library to exhaust the name, address and phone number of all category from a webpage. Few days back, when I created a scraper to parse a webpage ...
- 2,511
8votes
1answer
4kviews
Web Scraping with Python + asyncio
I've been working at speeding up my web scraping with the asyncio library. I have a working solution, but am unsure as to how pythonic it is or if I am properly ...
